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ABSTRACT 

An evaluation was done of New York City Public 
Schools' Bilingual Resource Instruction for the Development of 
Gainful Employment Skills Program (Project BRIDGES) , which served 
poor immigrant high school students. The program operated at three 
Brooklyn high schools (Sheepshead Bay High School, Franklin D. 
Roosevelt High school, and South Shore High School). It served 405 
limited English proficiency students with instruction in English as a 
Second Language (ESL) , native language arts (NLA) , content area 
subjects, and vocational skills. The program served students from 
many cultures, who spoke a variety of native languages including 
Spanish, Haitian Creole, Russian, Hebrew, and Arabic. Evaluation of 
the program was based on demographic data, citywide student test 
scores, and interviews with and surveys of the program director. In 
its final year of implementation, Project BRIDGES was fully 
implemented; provided at-risk students with essential supportive 
services and individualized instruction; and met its objectives for 
ESL, NLA, vocational courses, career development, attendance, and 
graduation requirements. Two appendices summarize the data collection 
and analysis methods and list instructional materials. (JB) 
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FOREWORD 



The body of this report is preceded by an Extract which presents as overview of salient points of 
the project: funding cycle; enrollment figures; background of students served: admission criteria; and 
programming features, strengths, and limitations, including the outcome of all objectives. The extract also 
presents the conclusions drawn by the Office of Research, Evaluation, and Assessment (OREA) about the 
program and its recommendations for program improvement. 

The extract is followed by the body of the report, titled Program Assessment . This includes such 
information as staffing, program implementation, and outcome and implementation objectives* 
Instructional objectives are presented first, followed by noninstmctbnal objectives. The report then 
addresses those aspects of programming mandated by Title VII regulations that do not have specifically 
stated objectives, This may be information on attendance and dropout rate, grade retention, 
mainst reaming, referrals out of the program to meet special needs of the students, and withdrawals, A 
case history concludes the report. 

Data for this profile were collected and analyzed using a variety of procedures, which are 
described in A ppendix A following the text. 



Office of Research. Evaluation, and Assessment 
New York City Public Scltoob 

E.S.E.A. Title VII Evaluation Profile 

Bilingual Resource Instruction for the Development of 
Gainful Employment Skills 
(Project BRIDGES) 

Grant Number: G008635376 
1990-91 

EXTRACT 

PROJECT DIRECTOR: Sandra Abrams FUNDING CYCLE: Year S of 5 
SITES 



School Borough Enrollment* 

(fall) (spring) 
Sheepshead Bay High School Brooklyn 155 144 

Franklin D. Roosevelt High School Brooklyn 145 131 

South Shore High School Brooklyn 73 55 



*The project enrolled 405 students (49 less than in the previous year), serving 373 in the fall and 330 in 
the spring. 



STUDENT BACKGROUND 



Native lang ua g e Number of Students Countries of Origin Number of Students 

Spanish 180 Haiti 72 
Haitian Creole 73 U.S.S.R. 67 
Russian 66 Mexico 33 
Hebrew 19 Dominican Republic 26 
Arabic 10 Israel 22 
Other Languages 39 Colombia 19 
Unreported 18 Other Spanish- 
speaking countries 73 
Asian countries 9 
Other countries 53 
Unreported 31 



Mean Years of Education in Native Country : 7.8; in the United States : 2.1 
• Percentage of Students Eligible for Free Lunch Program : 70.1 
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ADMISSION CRITERIA 



Students at risk of dropping out of school and whose Language Assessment Battery (LAB) scores were ai 
or below the 40th percentile were admitted to the project. Teacher recommendations and interviews with parents 
were required. 



PROGRAMMING 
Features 

Project BRIDGES provided students of limited English proficiency (LEP) with instruction in English as a 
Second Language (E.S.Lj, Native Language Arts (N.LA.), content area subjects, and vocational skills. 

Strengths and Limitations 

Articulation with non-project personnel and individualized student attention, with additional support and 
counseling, were project strengths. 



CONCLUSIONS AND RECOMMENDATIONS 

Project BRIDGES completed its final year of operation. It was fully implemented. Hie project provided 
at-risk students with essential supportive services and individualized instruction. Project BRIDGES met its 
objectives for E.S.L., N.LA., vocational courses, career development, attendance, and graduation requirements. 
It met two of three its objectives for content area subjects and partially met its dropout prevention objective. 



PROGRAM ASSESSMENT 



STAFFING 

Title VII Staff (Total 5) 
Title 

Site Coordinator 
She Coordinator 
Guidance Counselor 
Educ. Assistant 
Secretary 



Degree 

MA 
B.A. 

MA., M.S. 
High School 
High School 



Lan guage Competencies 

Spanish 

French 

Russian, French, Haitian Creole 



Funding 

Part time 
Part time 
Full time 
Full time 
Fufl time 



Other Staff Working With Project Students (Total 40) 



Decree 


Certification 




B.A. 7 


Russian 


2 


B.S. 2 


Mathematics 


4 


M.S. 7 


Spanish 


7 


M.A. 17 


Social Studies 


5 


M BA. 2 


Bil. Soc. Studies 1 


P.D. 2 


E.S.L. 


10 


J.D. 1 


Biology 


1 


Ed.D. 1 


English 


5 


Ph.D. 1 


A.P. For. Lang. 


1 




Guidance 


1 




French 


1 




Bil. Math 


2 




T.P.D. 


3 




D.H.S. (reg.) 


1 



Teaching/Communicative 
Proficiepcjes (TP/CP)* 



French 

Spanish 

Russian 

Haitian Creole 

Hebrew 

Italian 

Chinese 



TP 2 

TP 4, CP 1 
TP 4, CP 1 
TP 1 

TP 1, CP 2 
TP 2 
TP 1 



IMPLEMENTATION AND OUTCOMES (Objectives prefaced by •) 
English as a Second Language (E.S.L.) 

Level Periods Weekly 



Beginning 
Intermediate 
Advanced 
Transitional 



15 
10 
10 
10 



Computer-assisted writing lessons reviewed various occupations, the methods of choosing a career, and 
the management of job interviews (Le. t techniques, professional language). 

See Appendix B for a list of texts. 



•Teaching Proficiency (TP): Competent to teach in this language. 
Communicative Proficiency (CP): Conversational capability only. 
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• E.S.L program studcnis will make statistically significant gains in English proficiency. 
Evaluation Instrument: Language Assessment Battery (LAB)* 

Pretest: March 1990; posttest: March 199L 

Number of students for whom pre- and posttest data were reported; 272 

Mean gain: 10.0 N.CE.s (s.d.= 112} 

Mean gain is statistically significant (t- 13.58, j><.05). 

Project met objective. 

• English proficient students will make significant gains in English-reading achievement. 

Evaluation Indicator Final course grades. 

Of the 20 students who enrolled in English reading in the fall, 75 percent passed. Of the 38 students who 
enrolled in the spring, 86.8 percent passed. 

Project met objective. 

Native Language Arts (N.L.A.) 

Estimated percentage of students lacking literacy skills: 5 
N.L.A. was offered at Franklin D. Roosevelt High School only. 

Periods of N.L.A. at Franklin D. Roosevelt Hieh School 



Level S panish Chinese 
Beginning 5 5 
Intermediate 5 5 
Advanced 5 0 
Advanced Placement 5 0 



Class activities focused on raising the level of native language awareness by using a literature approach" 
to explore language. 

See Appendix B for a list of texts. 



f 



*OREA used a gap reduction design to evaluate the effect of supplementary instruction on project students' 
performance on the LAB. Since all LEP students in New York City are entitled to such instruction, no valid 
comparison group exists among these students, and OREA used instead the group on which the LAB was nonned. 
Test scores are reported in Normal Curve Equivalents (N.C&s), which are normalized standard scores with a mean 
of 50 and a standard deviation of 21.06. It is assumed that the norm group has a zero gain in N.CE.s in the absence 
of supplementary instruction and thai participating students* gains are attributable to project services. 
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• At lea?: 70 percent of students in NX. A* classes win score at or above the passing criterion of 65. 

Evaluation Indicator: Final course grades. 

Of the 153 students enrolled in N.L.A. classes in the fall 77,8 percent passed. Of the 133 students 
enrolled in the spring, 78.2 percent passed. 

Project met objective. 



Content Area Subjects 

Project students took courses in business, social studies, mathematics, and science that were taught with 
an E.S.L. methodology. 

• Sixty-five percent of the students with two or more years of participation in the program wiH pass the 
Regents Competency Test (R.CT.) in mathematics. 

Evaluation Instrument: Regents Competency Test (R.CT.) 

Number of students in project for two or more years: 27 

Percentage passing R.CT.: 29.6 

Project did not meet objective. 



• At least 70 percent of students will score at or above the passing criterion in subject area classes each 
semester. 

Evaluation Indicator: Final course grades. 

Passing Grades in Content Area Courses 



Fall Spring 

Enrollment Percent Passing Enrollment Percent Passing 

Mathematics 291 57.7 260 68.1 

Science 262 74.0 195 80.0 

Social studies 319 80.6 279 79.8 



Project met objective for science and social studies. 



• Seventy percent of the students will score at or above the passing criterion of 65 in business and 
vocational subjects. 

Evaluation Indicator. Final course grades. 

Of the 108 students enrolled in business and vocational subjects in the fall, 82.4 percent passed. Of the 
123 students enrolled in the spring, 72.4 percent passed. 

Project met objective. 
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Career Development 



• Seventy-five percent of the students served will demonstrate competency in work-seeking situations. 

According to the project director, all students who had successfully completed their business and 
vocational courses, and had received individual attention and counseling, had demonstrated competency in work- 
seeking situations. 

Project met objective. 
Attendance 

• Program students will have higher attendance than mainstream students. 
Evaluation Indicator School and project attendance records. 

Attendance Rates 



School Project Students' Rate Mainstream Students' Rate 



Sheepshead Bay High School 84.7 82.6 

Franklin D. Roosevelt High School 873 86.7 

South Shore High School 88.0 86 9 



Project met objective. 
Dropout Rate 

# Program students will have a lower dropout rate than similar non-program students. 
Evaluation Indicator: School and project records. 

Dropout Rates 



School Project Students* Rate Mainstream Students' Rate 

Sheepshead Bay High School 6.0 10.7 

Franklin D. Roosevelt High School 3*9 4.7 

South Shore High School 3.5 1.2 



Hie dropout rate for program students was higher than for mainstream students at South Shore 
High School. 

Project met objective at Sheepshead Bay and Franklin D. Roosevelt High Schools only. 
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Graduation Requirements 



• The number of program students graduating from high schoc! will be proportionately equal to or 
greater than the number of graduating mainstream students, 

Evaluation Indicator: Graduation records. 

Graduation Rates 



School Project Students' Rate Mainstream Students' Rate 

Sheepsbead Bay High School 100.0 • 

Franklin D. Roosevelt High School 90.0 83.5 

South Shore High School 100.0 



'Comparison unnecessary in view of project students 9 perfect graduation rate. 
Project met objective. 

Parental Involvement 

Parents at all three schools participated iii a Parent Advisory Committee. Parents were informed of 
students' social and academic progress as well as of graduation requirements. At Franklin D.Rooseveh High 
School, parents were given a list of diploma requirements translated into Russian. Project staff met individually 
with parents regarding their chfldrens* progress and maintained communication via phone calls and letters. 

Other Activities 

Approximately eight project students participated in a multicultural panel designed to promote 
mainstream student acceptance of immigrant LEP students (sponsored by "Outward Bound* 9 ). A quest km-and* 
answer session was conducted to facilitate better understanding. 

Project staff provided guidance and counseling services to project students at the three sites. Students 
freely approached project staff since staff members were well-known to the students and spoke their native 
language. 

STUDENTS WITH SPECIAL ACADEMIC NEEDS 



Number of Students Percentage 

Referred to special education: 4 1.0 

Referred to remedial programs: ) 0.0 

Referred to gifted and talented programs; 0 0.0 

Retained in grade: 43 11.6 
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MA1NSTREAMING 



Fifteen students (3.7 percent of participants) were mainstreamed. 
Acadeflifr Achfrvemept of Fon^r Projects Studept? iff Mafostr^ 



The site coordinator of Franklin D, Roosevelt and Sheepsbead Bay High School was responsible for 
organizing conferences with E.S.L. and subject area teachers to discuss the progress of mainst reamed students. 
At South Shore High School, the guidance counselor was responsible for student follow-up meetings. Data were 
available on 18 of the program participants who bad been mainstreamed in the previous year. Their subsequent 
performance is presented below: 

Mainstream Subject Students Enrolled Students Achieving Passing Grades 



English 11 9 (81 .8 percent) 

Mathematics 9 9 (88.9 percent) 

Science 6 6 (100 percent) 

Social Studies 12 12 (91.7 percent) 

Business/Vocational 3 3 (100 percent) 



CASE HISTORY 

A. came into South Shore High School as an eighth-grader. He had no English language skills. He 
began at the lowest level of mathematics and graduated with Advanced Placement competency. A. was selected 
to participate in "Opportunity to Learn," a program providing career counseling to promising bilingual students. 
He also participated in a multicultural panel of LEP students working to promote mainstream students 9 rapport 
and understanding. A. was channeled into the computer Held as a result of staff guidance and support. He was 
accepted into the State University of New York (SUNY) at Plattsburg and was enthusiastic at the prospect of 
going away to school 
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APPENDIX A 



DATA COLLECTION AND ANALYSIS 

Student Data Form 

This one-page form is filled out by staff for each participating and mainstreamed student. OREA gathers 
data from this form on backgrounds, demographics, academic outcomes, attendance, referrals, and exit from the 
program. 

Project Director's Questionnaire 

The Project Director's Questionnaire includes questions on staff qualifications, program implementation, 
periods of instruction, and instructional materials and techniques. 

Project Director's Interview 

The interview gathers information on program and student or staff characteristics not supplied by the 
Project Director's Questionnaire. The interview also allows project staff to offer qualitative data or amplify 
responses to the Questionnaire. 

Citvwide Test Scores 

OREA retrieves scores centrally from the Language Assessment Battery (LAB) and other citvwide tests. 
For evaluation purposes, these test scores are reported in Normal Curve Equivalents (N.C.E.s). N.CE.s are 
normalized standard scores with a mean of 50 and a standard deviation (s.dL) of 21.06. They constitute an equal- 
interval scale in which the distance is the same between any two adjacent scores. A gain of 5 N.C.E.s is ihe same 
whether it is at the lower or the higher end of the scale* N.C.E.s can be used in arithmetic computations to 
indicate group progress. (Percentile scales, although more familiar to many, are unsuitable for such computations 
since they are not equal-interval.) 

Likert-TVpe Smvevs 

Likert-type surveys, in which respondents mark their opinions on a scale from one to five, are used in a 
variety of ways. They examine student attitudes (i.e., toward school and career, native language use, and native 
and mainstream cultures). They also assess staff and parent attitude and reactions to workshops and other 
activities. 

Gap Reduction Evaluation Design 

OREA uses a gap reduction design for measuring changes in standardized tests. Since no appropriate 
non-project comparison group is available in New York City, where all students of limited English proficiency 
(LEP) are entitled to receive supplementary services, OREA compares the progress of participating students with 
that of the group on which the test was normed It is assumed that the norm group would show a zero gain in 
the absence of instruction, and gains made by project students could be attributed to project services. 
(See Xitywide Test Scores* above.) 

To test whether pre/posttest gains are greater than could be expected by chance alone, OREA uses a 
Mest To determine whether a difference between two proportions (e.g., program and mainstream attendance 
rates) is greater than could be expected by chance, OREA uses a z-test. Ihe level of significance is set at .05 for 
all tests* 
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APPENDIX B 



Instructional Materials 



Turning Points 
1, 2, 3, & 4 
Write From the Sun 



Iamornc & Papa 
Davidson & Biat 



Addison -Wesley 
Newbury House Publishers 



E.S.L. Transitional 
The Outsiders 
The Cay 

Currents in Poetry 
Reading literature 

9th grade level 
Romeo and Juliet 
Of Mice and Men 
The Friends 
The Miracle Worker 



S.E. Htnton 
Theodore Taylor 

Orange 

Shakespeare 
Steinbeck 
Rosa Guy 
Paul Gibson 



Dell 
Avon 

Current Series 
McDougal, Little 

McMillan 
Bantam 
Bantam 
Bantam 



Mathematics 

Algebra 1 Dressier 

Math Skills Workbook Goozner 

Essential Math Skills Gafney /Beeves 

Key to Algebra, Book I Rasmussen 
Mastering Computational Skills 8,9 BelVGawronski 

Math for Today Tobin, Grossman 



Am sco 

Amsco 

McGraw-Hill 

Key Curriculum Proj. 

Scott, Foresman Co. 

Sadlier-Oxford 



Biology & Human Progress 

Social Studies 
Men & Nations 
National Issues Forum 



Charles Tanzer 
Mazour & Peoples 



Prentice-Hall 



Harcourt Brace Jovanovkh 
KendaU-Hunt 



N.L.A. 



Chifttsc*. 

Exploring World Culture 
Exploring World History 
World Studies (Chinese) 

Advanced Chinese Language Readers, Books I, II, III 



Spanish: 

Narra ciones 

EI Iibro De Arena 

Bodas De Sangre 

Yerma 
1 Cien Anos Soledad 

El Amor En Los 
Tiempos Del Colera 
* Fiesta Al Noroeste 

El Tiempo 

Niebla 

Abel Sanchez 



Jorge Luis Borges 
Federico Garcia Lorca 
Federico Garcia Lorca 
Gabriel Garcia Marquez 

Gabriel Garcia Marquez 
Ana Maria Matute 
Ana Maria Matute 
Miguel De Unamuno 
Miguel De Unamuno 
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